On the Stability Region of Multi-Queue 
Multi-Server Queueing Systems with Stationary 

Channel Distribution 

Hassan Halabian, Ioannis Lambadaris, Chung-Horng Lung 
Department of Systems and Computer Engineering, Carleton University, Ottawa, ON, Canada 
Email: {hassanh, ioannis, chlung}@sce.carleton.ca 



o 

O 

Q 



O 



> 

oo 



X 



Abstract — In this paper, we characterize the stability region 
of multi-queue multi-server (MQMS) queueing systems with 
stationary channel and packet arrival processes. Toward this, the 
necessary and sufficient conditions for the stability of the system 
are derived under general arrival processes with finite first and 
second moments. We show that when the arrival processes are 
stationary, the stability region form is a polytope for which we 
explicitly find the coefficients of the linear inequalities which 
characterize the stability region polytope. 

I. Introduction 

Stability region or network capacity region of a commu- 
nication network is the closure of the set of all arrival rate 
vectors for which there exists a resource allocation policy that 
can stabilize the system |fl~)-0. Having the stability region 
of a network characterized by a set of convex inequalities, we 
can obtain a precise solution for network fairness optimization 
problems with the general form of (Q~|). 
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r = (ri,r 2 , ...,r N ) e A 
<r„ < A„ Vn = 1,2,..., N 

In ([T), N is the number of traffic sources. By r = 
(r l7 r 2 , rjy), we denote the admitted rate vector, A„ is the 
input rate of each source n and A denotes the stability re- 
gion. Functions f n (r n ) are non-decreasing and concave utility 
functions. The choice of f n (r n ) determine the desired fairness 
properties of the network. The goal of this paper is to char- 
acterize the network capacity region of Multi-Queue Multi- 
Server (MQMS) queueing systems with stationary channel dis- 
tribution (i.e., A for MQMS system). Such queueing systems 
are used to model multiuser wireless networks with multiple 
orthogonal subchannels such as OFDMA access networks. 
The resource allocation in such networks can be modelled 
as the server allocation problem in multi-queue multi-server 
queueing systems with time varying channel conditions [@)- 
0. 

The stability problem in wireless queueing networks was 
mainly addressed in fl]-0, 0, O— flTT). In 0, the authors 
introduced the notion of capacity region of a queueing net- 
work. They considered a time slotted system and assumed 
that arrival processes are i.i.d. sequences and the queue length 
process is a Markov process. In [10|, they characterized the 
network capacity region of multi-queue single-server system 
with time varying ON-OFF connectivities. They also proved 



that for a symmetric system i.e., with the same arrival and 
connectivity statistics for all the queues, LCQ (Longest Con- 
nected Queue) policy maximizes the capacity region and also 
provides the optimal performance in terms of average queue 
occupancy (or equivalently average queueing delay). In [1], [2| 
and [11 J, the notion of network capacity region of a wireless 
network was introduced for more general arrival and queue 
length processes. 

The problem of server allocation in multi-queue multi-server 
systems with time varying connectivities was mainly addressed 
in flU-G), 10. In 0, Maximum Weight (MW) policy was 
proposed as a throughput optimal server allocation policy for 
MQMS systems with stationary channel processes. However, 
in the conditions on the arrival ttaffic to guarantee the 
stability of MW were not explicitly mentioned. In our previous 
work [9 1, we characterized the network capacity region of 
multi-queue multi-server systems with time varying ON-OFF 
channels. We also obtained an upper bound for the average 
queueing delay of AS/LCQ (Any Server/Longest Connected 
Queue) policy which is the throughput optimal server alloca- 
tion policy for such systems. 

In this paper, we characterize the stability region of multi- 
queue multi-server queueing system with stationary channel 
and arrival processes. Toward this, the necessary and sufficient 
conditions for the stability of the system are derived for 
general arrival processes with finite first and second moments. 
For stationary arrival processes, these conditions establish the 
network stability region of such systems. Our contribution in 
this work is to characterize the stability region as a convex 
polytope specified by a finite set of linear inequalities that 
can be numerically tabulated and used to solve network 
optimization problem (Q]). We further inttoduce an upper bound 
for the average queueing delay of MW policy which is a 
throughput optimal policy for MQMS systems. 

The rest of this paper is organized as follows. Section 
HTl describes the model and notation required throughout the 
paper. In section Hill we discuss about some preliminary 
definitions (stability definition, polytope, etc.) used in the 
paper. In section IIV1 we will derive necessary and sufficient 
conditions for the stability of our model and also find an upper 
bound for the average queue occupancy (or average queueing 
delay). Section IVl summarizes the conclusions of the paper. 

II. Model Description 

Before we proceed to describe the model, we introduce 
basic notations often used throughout the paper. Other no- 




Fig. 1: Multi-queue multi-server queueing system with station- 
ary channel distribution 

tations are introduced whenever it is necessary. Through this 
paper, all the vectors are considered to be row vectors. The 
time average of a function f(t) is denoted by f(t), i.e., 
f(t) = linit^oo j J2t=i f( T )- The operator "©" is used 
for entry-wise multiplication of two matrices. By 1 K (0 K ), 
we denote a row vector of size K whose elements are all 
identically equal to "1" ("0"). The cardinality of a set is 
shown by • |. For any vector a = (pc\, a 2 , a^) and a non- 
empty index set U — {u%, U2, —, U\u\} ^= {1> 2, N} and 
ui < u 2 < ... < u\ u \, we define a u = {a Ul ,a U2 , ...,a U|M| ). 

We consider a time slotted queueing system with equal 
length time slots and equal length packets. The model consists 
of a set of parallel queues Af = {1,2, N} and a set of 
identical servers JC = {1,2,...,K} (Figure [TJ. Each server 
can serve at most one queue at each time slot, i.e., we do not 
have server sharing in the system. At each time slot t, the 
capacity of each link between each queue n G Af and server 
k G /C is assumed to be C n .k(t) packets/slot. We assume that 
C n .k{t) S M where M — {m G Z + | m < M} for given 
M. Therefore, at each time slot t, the channel state may be 
expressed by an N x K matrix of C(t) ~ (C ni fc(t)) ,n G 
Af, k G K,,C n ,k(t) £ AA. The channel process is defined as 
{C(t)}'^_ 1 with the state space S. Note that S is a finite set 
with \S\ = (M + 1) NK . We label each element of S by a 
positive integer index s G {1,2,..., (M + 1) NK }. Suppose 
that the channel state matrix associated to the channel state s 
is denoted by C s . The channel state of the system is assumed 
to have stationary distribution, with stationary probabilities 
tt s = Pr(C(t) = C s ). 

Assume that the arrival process to each queue n £ Af at 
time slot t (i.e., the number of packet arrivals during time slot 
t) is represented by A n (t). Thus, the arrival vector at time slot 
iis denoted by A(t) = (Ai(t), A 2 (t), A N (t)). Assume that 
ElAf^t)] < Af nax < 00 for all t. Each queue has an infinite 
buffer space. New arrivals are added to each queue at the end 
of each time slot. Let X(t) — (Xx(t), Xjy(t)) be the queue 
length process vector at the end of time slot t after adding new 
arrivals to the queues. 

A server scheduling policy at each time slot should decide 
on how to allocate servers (from set K.) to the queues (in 
set A/"). This must be accomplished based on the available 
information about the channel state of the system at time slot 
t (which is C(t)) and also the queue length process at the 
beginning of time slot t (which is X(t — 1)). In other words, 
at each time slot t, the scheduler has to determine an allocation 



matrix I(t) G I where 

1 = j/jVxK = (In,k)Jn,k G {0, 1} | = 1 Vfc G fcj 

We can easily observe that the queue length process evolves 
with time according to the following rule. 

X T (t) = (X T (t-l)-(C(t)®I(t))l T K ) + + A T (t) (2) 

where (•)+ is defined as follows: For an arbitrary vector v of 
size |u|, (v) + is a vector of the same size whose i'th element 
(v)f = Vi if Vi > and zero otherwise. 

III. Background 

A. Strong Stability 

We begin with introducing the definition of strong stability 
in queueing systems (TJ, (2), ifTTl . Other definitions can be 
found in 0, iflOll . lfl2l . Consider a discrete time single queue 
system with an arrival process A[t) and service process fi(t). 
Assume that the arrivals are added to the system at the end of 
each time slot. Hence, the queue length process X(t) evolves 
with time according to the following rule. 

X(t) = (X(t-l)-n(t)) + +A(t) (3) 

Strong stability is given by the following definition (TJ. 

Definition 1: A queue satisfying the conditions above is 
called strongly stable if 

1 

limsup - E i x ( T )} < °o ( 4 ) 

Naturally for a queueing system we have the following 
definition JT]. 

Definition 2: A queueing system is called to be strongly 
stable if all the queues in the system are strongly stable. 

In this paper, we use the strong stability definition and from 
now we use "stability" and "strong stability" interchangeably. 

B. Some Fundamental Concepts of Polytopes 

In this part, we will have a brief review on the notion of 
convex polytopes and some fundamental properties of them. 
These concepts are needed when describing the stability region 
of MQMS system in section |IV] 

Definition 3: A convex polytope is defined as the convex 
hull of a finite set of points ITU, fl4l . 

According to the Weyl's Theorem lfl3l . a 
polytope in M. always can be expressed by a set 
{x G M. N I agx T < fit , I = 1,2, for some positive 
integer L and a e G 1* and e M. 

Dimension Theorem lTT3l : For a polytope V C M w , di- 
mension of V is equal to N minus the maximum number 
of linearly independent equations satisfied by all the points in 
V. 

Definition 4: An equality ax 1 < b is called valid for 
polytope V if for every point xo G V, cixq < b. 

Definition 5: A face of polytope V is defined as T = {x G 
V j ax T = b} where inequality ax T < b is a valid inequality 
for V. 



We call the hyperplane axj = b associated to the valid 
inequality clXq < b a face defining hyperplane for V if its 
associated face is not empty. In other words, axj = b is a 
face defining hyperplane for V if it intersects with V on at 
least one point. Note that V has finitely many faces. However, 
the face defining hyperplanes of a polytope can be infinite. 

Definition 6: A facet of polytope V is a maximal face 
distinct from V lfl4l . In other words, all faces of V with 
dimension dim('P) — 1 are called facets of V. 

For polytope V = {x € R N \ a e x T < /3 e , £ = 1,2, L) 
an inequality is redundant if polytope V is unchanged by 
removing the inequality. 

Redundancy Theorem in Polytopes: Face defining hyper- 
planes (inequalities) describing faces of dimension less than 
din^T 5 ) — 1 are redundant iPPHl . 

Redundancy theorem states that to describe a polytope 
completely, only facet defining hyperplanes (inequalities) are 
sufficient. 

IV. Necessary and Sufficient Conditions for the 
Stability of MQMS System 

A. Necessary Conditions for the Stability of MQMS System 

We introduce the departure matrix HNxK(t) — 
(H n ,k(t)),n G Af,k 6 /C in which H n ^{t) represents 
the total number of packets served by server k from queue 
n at time slot t. Obviously H n j,(t) < C n ^(t). Thus, 
the departure process from queue n at time slot t would 
be 2~2k=i Hn,k(t)- The following equality illustrates the 
evolution of queue length process with time. 

K 

X n (t)=X n {t-l)-J2 H nA t )+ A n{t) VneTV (5) 
fc=i 

Let Q be the class of deterministic policies in which at each 
state of the system, each policy g G Q allocates the servers 
according to a predetermined allocation matrix. Therefore, 
each deterministic policy g is specified by \S\ allocation 
matrices ii 9 ^ , s G S. Note that set I is a finite set and since 
the channel state space is also finite, set Q is finite. 

A deterministic policy g will result into an average trans- 
mission rate for each queue n. Let Rn^ denote the time 
averaged transmission rate provided to queue n and := 
(r[ 9 \r { 2 9 \ It follows that, 

Ws / 

Each rate vector Rs 3 ' determines a single point in R^f. Now, 
consider the convex hull of all the points R^ 9 \ g G Q in R?, 
i.e., TZ — conv. hull{R { ^). 

According to the above discussion and definition of convex 
polytope, we can show that the set of achievable transmission 
rate vectors 1Z is specified by a polytope. Henceforth, we 
denote the achievable transmission rate polytope by V. 

Note that convex hull representation of the stability region 
may not be suitable to use in network optimization problems 
like (fl}. Since it does not provide mathematical statements in 
a form to be used as the constraints in <[TJ. In the following, 



we will characterize the stability region by a set of linear 
inequalities. To introduce the necessary conditions for the 
stability of MQMS system we need to prove a series of 
Lemmas (Lemmas [TJ to [5j. In this paper, the proofs were 
skipped due to space limitation. 

Lemma 1: If the MQMS system is strongly stable under 
a server allocation policy A, then for any vector a = 
(ai, o?2, aw) G R+ we have 

t t 
lim - ]T aE[A(r)] T = lim - £ aE[H(r)]l T K . (7) 

T=l T=l 

Lemma 2: If the MQMS system is strongly stable under a 
server allocation policy A, then E[A(t)] G V. 

Lemma 3: If the MQMS system is strongly stable under a 
server allocation policy A, then for all a G 

aE[A(t)] T < ^ t« max ( a ( c s © (8) 

As we can see, the number of inequalities defined in <[8J is 
infinite. Note that each inequality in © determines a valid 
inequality for polytope V. It is not hard to show that the 
hyperplanes associated to the valid inequalities of ([8]l are 
all face defining hyperplanes of polytope V. To see this, let 
I a denote a set of allocation matrices of {/f,s G S} that 
maximizes the right hand side of ([8]), i.e., 

I™ = arg maxa(C s ® (9) 

Note that I a is not unique and there may be more than one 
set of allocation matrices of I a whose elements maximize 
a(C s © I)Xk- According to © and definition of polytope 
P> (J2ses 7: s(C s ®If)lJ c ) T G V. On the other hand, 
E.g5^«(C- © !T)Ik = a£. e WC. © Thus, 
(£ s£iS 7r s (C s ®I")Xk) is located on the hyperplane as- 
sociated to ([8]). In other words, the hyperplane associated to 
dHJ touches polytope V. So, the set of inequalities of ([8]) are 
all face defining hyperplanes of polytope V. According to 
redundancy theorem in polytopes [ 13 1, not all the face defining 
hyperplanes of a polytope are required to determine a polytope 
completely. The inequalities corresponding to the facets of a 
polytope are just sufficient to characterize a polytope. In the 
following, we will characterize the facets of polytope V. 

Let V denote the set of vectors a G with the following 
property, i.e., 

V :={ae 

V(WCjV,W^0,a u ^ 0| M |, a U a ^ 0, W c | ) 
3 (i G U, j G U c , m,n G M., ai,aj,m,n ^ 0) 

: aim = ctjn} (10) 

In other words, a vector a belongs to set V if for any 
partitioning of elements of vector a into two non-empty 
disjoint (sub)vectors in which all the elements of each vector 
are not identically equal to zero, there exists at least one non- 
zero element in each vector, the ratio of which is equal to ratio 
of two non-zero elements of set M. To clarify the definition 
of set V consider the following example. 

Example: Let A4 — {0, 1, 2} and N = 4. Consider vector 
a\ = (1, 2, 5, 10). We can partition ot\ to ot\ {1 , } = (1, 2) and 



ai {3 4} = (5, 10). Note that there exist no elements in a 1{1 2} 
and a 1{3 4} whose ratio is 1 or 2 and therefore, a\ £ V. 
Another example is the vector a 2 = (0,2.5,0,0) in which 
for any partitioning of the vector into two non-empty disjoint 
parts, one part will always have all the elements identically 
equal to zero. Therefore, a-i G V. 

In the following we will show that any vector in — V 
cannot form a facet defining hyperplane for polytope V and 
therefore the inequalities derived by the vectors of set R^ — V 
are redundant to characterize polytope V. 

Lemma 4: The hyperplane associated to the valid inequality 
of ([8]) is not a facet defining hyperplane of V if a G R^ — V. 

Set V is an infinite set. However, we can show 
that set V is finite up to multiplication of vectors by 
positive scalars. To show this, we define set W = 
|z G Z + | z = Tif^i 1 m ji m j M\. Then, we consider the 
set W N — {(ai, «2, Qijv) I oi n € W}. We can prove the 
following Lemma. 

Lemma 5: There exists V C W N such that any vector a 6 
V can be written as a = q/3 for some f3 G V and q > 0. 

We can show that \W N \ = (( M ^_r 2 ) + l) ■ Since V C 

W N , therefore | V" | < \W N \ - 1 (excluding the vector 0^). 

We now introduce the necessary conditions for the stability 
of MQMS system with stationary channel distributions by the 
following theorem. 

Theorem 1: If there exists a server allocation policy A 
under which the system is stable, then 

aE[A(t)] T < max (a(C s © , a G V. (11) 

ses 

The proof follows from Lemmas [1] to [5] 

Note that according to Theorem [T] in order to characterize 
polytope V, we have to specify all the elements of set V 
which can be obtained after considering all possible vectors 
a G W N — N and removing redundancies following ( TTOb . 
This can be done using numerical computations. We may also 
use a G W N — N instead of a G V in jilt . Although by using 
W N — N we may obtain some redundant inequalities, since 
\W N — N \ < oo we still have a finite number of inequalities 
to describe polytope V. Table U depicts V and \W N \ — 1 for 
some simple cases of N = 2, 3 and M = 1,2,3, 4. 

TABLE I: \V\ and \W N \ - 1 for N = 2, 3 and M = 1, 2, 3, 4 





M= 1 


M = 2 


M = 3 


M = 4 


\V\,\W N \-1 


N = 2 


3,3 


5,8 


9, 15 


12,24 


N = 3 


7,7 


25,63 


109, 342 


253, 1330 



Corollary 1: For an MQMS system with stationary arrival 
processes, we have E[A(t)] = X = (Ai, A2, Ajv) and the 
necessary conditions for the stability of the system would be 

aA T < ^tt s max (a(C a © 7)1^) , aeV, (12) 

Corollary 2: For an MQMS system with ON-OFF chan- 
nels, we have W = {0,1} and therefore the necessary 
conditions for the stability of the system become 

aE[A{tY < ^ s TJ 1 ! ( a(Cs ® ' a " G { °' 1} (B) 

s£5 



In a special case considered in (9) where the channels are 

modelled by independent Bernoulli random variables with 

E[C n: k{t)} = p n ,k> the necessary conditions for the stability 

of the system are given by 
K 

E iMr)] < k - n 0- - y ® ^ N - ^ 14 > 

neQ fc=lnGQ 

In this case, the total number of inequalities needed to describe 
the polytope V is equal to 2^ — 1. 

B. Sufficient Conditions for the Stability of MQMS System 

Consider a server allocation policy which determines the 
allocation matrix at each time slot t by solving the following 
maximization problem. 

I{t) = axgmaxX(t - l)(C(t) © I)Ik (15) 

This policy is called Maximum Weight (MW) and was first 
introduced in 0, 0. According to the constraints on al- 
location matrix I, we can easily conclude that MW policy 
allocates the servers by the following rule: At each time slot 
t, MW policy allocates each server k to queue n who has 
the maximum X n (t — l)C n k(t). In the special case where 
the channels are ON-OFF, the policy is equivalent to AS/LCQ 
(Any Server/Longest Connected Queue) introduced in |9l. In 
the following, we derive sufficient conditions for the stability 
of our model and prove that MW stabilizes the system as 
long as condition ( fToT l is satisfied. An upper bound is also 
derived for the time averaged expected number of packets in 
the system. 

Theorem 2: The MQMS system is stable under MW if for 
all t 

aE[A(t)] T <J2tt s max (a{C s © , a G V (16) 

Furthermore, the following bound for the average expected 
"aggregate" occupancy holds. 

t^oo t ^— ' 2d 

t — n— 1 

where 6 is the maximum positive number such that for all t 
we have E[A(t)] + Sl N e V. 

Corollary 3: For an MQMS system with stationary arrival 
processes, we have = A and the sufficient conditions 

for the stability of the system under MW policy become 
aA T < Y,ses n s max/ e i (a(C s © , a G V. 

According to Corollaries [1] and [3] and the definition of 
network capacity region, we can conclude that for an MQMS 
system with stationary channel distribution and stationary 
arrival processes, the stability region is characterized by ( fT2l . 

Consider an MQMS system with ON-OFF channels. For 
such a system, the MW policy is equivalent to AS/LCQ policy 
introduced in (9|. In AS/LCQ the policy takes an arbitrary 
ordering of servers (to be allocated to the queues) and then 
for each server, AS/LCQ allocates it to its longest connected 
queue (LCQ). Note that in such a system, W = {0, 1} and 
therefore we will have the following corollary. 



Corollary 4: The MQMS system with ON-OFF channels is 
stable under AS/LCQ if for all t 

aE[A(t)] T < ^ tt s max (a{C s © J)l£) , a„ G {0, 1} (18) 

In a special case where the channels are modelled by inde- 
pendent Bernoulli random variables with E[C n< k(t)] = p n ,k, 
AS/LCQ stabilizes the system if 

K 

^2E[A n (T)]<K-^2U(l- Pn , k ) VQCAA (19) 

neQ fclngQ 

C. Stability Region for Fluid Model MQMS Systems with 
Stationary Continuous Channel Distributions 

We will consider a time slotted fluid model MQMS system 
with stationary channel distributions. In this case, the amount 
of work that arrives into (and departs from) the queues is 
considered to be a continuous process. We also assume that 
the channel state of the link from each queue to each server is 
modelled by a continuous random variable. The channel state 
matrix in the fluid model MQMS system is defined as C(i) = 
(C n ,k(t)) ,n G J\f,k G rC, C n ,k(t) € K+. We assume that the 
channel state follows a stationary distribution /c(c). fc is me 
joint distributions of all C n> k variables. We can easily check 
that in the fluid model MQMS system, set V is equivalent to 
as in the fluid model MQMS system, set Ai is replaced 
with M+. Therefore, stability region for the fluid model system 
is characterized by the following set of inequalities. 

/>oo />oo />oo 

aA T < / / • • • / max (a(c © J)l£) 

x /c(c) efc M ■•• dc n ,k-i dc„ tk a G R+ (20) 

Note that in order to characterize the stability region of the 
fluid model system we need to compute an infinite number 
of integrals in (120b . In fact, the stability region of fluid model 
system is characterized by infinite number of half spaces which 
means that the stability region is a convex surface. In this case, 
depending on the channel distribution and dimension of the 
system, we could characterize the stability region by a limited 
number of non-linear inequalities instead of infinite number 
of linear inequalities as we show in the following example. 

Example: Consider a fluid model MQMS system with 
two queues and one server. Suppose that the channel state 
variables C\ \ and are independent and follow exponen- 
tial distribution with means fix and \i<i, respectively. Such a 
modelling is used to model slow Rayleigh fading channels 
with low SNR where the approximation log(l+a;) ~ x is valid 
for small positive x. We can show that the stability region for 
this example is described by 

for Ai > and A2 > 0. The derivation of (|2T1 > is skipped 
because of space limitation. As we can see from equation ( f2TT >. 
the stability region in this example is characterized by just one 
non-linear inequality (fJTJ and two linear inequalities Ai > 
and A2 > 0. The stability region for this example for Hi = 2 
and /12 = 1 is illustrated in Figure [2] 
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Fig. 2: Stability region for \i\ = 2 and \i% = 1 

V. Conclusions 

In this paper, we characterized the stability region polytope 
of multi-queue multi-server (MQMS) queueing systems with 
stationary channel and packet arrival processes by a finite 
set of linear inequalities given by ( fT2b . We also argued that 
in general it may be (computationally) hard to quantify set 
V from set W N . In this case, we can use set W N itself 
instead of V in ( TT~2T > as V C W , although we may have 
some redundant inequalities. We also considered the stability 
region for a fluid model MQMS. In this case, we determine the 
stability region by an infinite set of linear inequalities given by 
( |20T ). Finally, by use of an example we showed that depending 
on the channel distribution and number of queues, we may 
characterize the stability region by a finite set of non-linear 
inequalities instead of infinite set of linear inequalities. 
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